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TO ALL WHOM IT MAY CONCERN: 

Be it known that we, A. John Michaelis, a citizen of the United States, 

residing at 393 Darling Street, Balmain NSW 2041, Australia, and James L. Warmus, 
a citizen of the United States of America, residing at 350 S. Kensington, LaGrange, 
60525, in the County of Cook and State of Illinois have invented a new and useful 
METHOD AND APPARATUS FOR PROVIDING AUDIO/VISUAL FEEDBACK 
TO SCANNING PEN USERS, of which the following is a specification. 



METHOD AND APPARATUS FOR PROVIDING AUDIO/VISUAL 
FEEDBACK TO SCANNING PEN USERS 

RELATED APPLICATION 

This application claims priority from U.S. Provisional Application 
Serial No. 60/226,746 filed August 21 , 2000, and which is hereby incorporated 
herein by reference. 



TFCHNICAL FIELD 

The present system relates in general to data entry using 
machine readable symbols, such as bar codes, and in particular to methods 
and apparatus for providing audio/visual feedback to scanning pen users. 



BACKGROUND 

As the business of image-scanning pens and/or other image 
scanning systems develops, it may become important to provide audible 
and/or visual feedback of the scanning operation. For example, a catalog 
may contain scannable codes or glyphs to enable a customer to use a 
scanning pen to order products. The ordering process may be complex. For 
example, a user wishing to purchase shirts may need to specify style, size, 
color and quantity for each item. The scanning pen may be isolated from the 
Internet and other sources of information, and the pen may not have a large 
amount of memory. Accordingly, retrieval of audio and/or visual feedback 



data may be limited. 



RRIFF DESCF 'PTtON OF THF DRAWINGS 

Features and advantages of the disclosed system will be 
apparent to those of ordinary ski., in the art in view of the detai.ed description 
of exemplary embodiments which is made with reference to the drawings, a 
brief description of which is provided below. 

FIG. 1 is a high level block diagram of an exemplary 

communications system. 

FIG. 2 is a more detailed block diagram of one of the servers 

illustrated in FIG. 1- 

FIG. 3 is a more detailed block diagram of one of the personal 

computers illustrated in FIG. 1 . 

FIG. 4 is a more detailed block diagram of one of the scanning 

devices illustrated in FIG. 1. 

FIG. 5 is an exemplary printed page which may be used for 

ordering a product via the scanning device of FIG. 1 . 

FIG. 6 is a flowchart of a process for providing audio and/or 
visua. feedback to a user during a shopping sequence based on audio and/or 
visual data encoded in a machine readable symbol. 

^.n pn nPSCRIF™" ™ ™ p PREFFFFFP FMBODIMENTS 

in general, the system described herein retrieves audible and/or 
visua. data stored in a machine readable code, such as a standard bar code, 
a two dimensions bar code, a g.yph, etc. When the code is scanned by a 
scanning pen or other scanning device, the pen provides audible or visua. 
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feedback to the user. The feedback guides the user through a process, such 
as a shopping sequence, providing instructions to the next input or action, in 
addition, each code may also contain data indicative of a user response to a 
previous audio/visual prompt. For example, a single machine readable code 
may contain data indicative of -size=large- and "prompt=Wha. color?'. 
Optionally, the scanning device may store an identification code which is 
compared to an authorization code stored in the machine readable code to 
determine if the user of the scanning device is authorized to see or hear 
certain information which is also stored in the machine readable code. 

A high level block diagram of a communications system 100 
providing an exemplary environment of use is illustrated in FIG. 1 . The 
system 100 includes one or more servers 102. one or more personal 
computers (PCs) 104, and one or more scanning devices 106. Each of these 
components may communicate with each other via a connection to the 
internet or some other wide area network 108. Typically, servers 102 store a 
plurality of files, programs, and/or web pages for use by the PCs 104 and/or 
scanning devices 106. One server 102 may handle requests from a large 
number o, clients (i.e., PCs 104 and/or scanning devices 106). Accordingly, 
each server 102 is typically a high end computer with a large storage 
capacity, one or more fast microprocessors, and one or more high-speed 
network connections. Conversely, relative to a typical server 102, each PC 
,04 typically includes less storage capacity, a single medium to high-speed 
microprocessor, and a single medium-speed network connection. 
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A typical scanning device 106 includes even less storage 
capacity, Pressing power, and bandwidth capacity than a typical PC 104. 
A scanning device 106 may be connected to the networK 108 directly via a 
modem and/or other networK interface, or a scanning device 106 may be 

Any of these connections may be a wired connection or a wireiess 
connection. Often, a scanning device 106 is disconnected from the networK 
108 and,or me PCs 104. However, scanning operations P re,erab,y operate 
even when the scanning device 106 is in such a stand aione mode. In one 
embodiment, different users may be given pens which contain identtfcation 
oo.es Optionally, each identification code is unique. In this manner, different 
processes may be followed based on the user's identity (even i, the scanned 
ooae is the same for different users). For example, a doctors pen may 

id en,i,y of the person performing the scanning operation may be recorded. In 
this embodiment, the scanning pens may be color coded to .achate visual 
identification of an associated authorization level. 

Optionally, the user of a scanning pen may be required to enter 
a pass code in order to operate the pen a, a certain authorization level. For 



be acceded by tradrcona, input means or by scanning a "private" symbo,. 
For example, a doctor may manua„y enter a persona, identHication number 
using a smai, Keyboard (e.g., up/down arrows, numbers, letters, etc.) on the 

of his identification badge. 

A more detailed block diagram of a server 102 is i„ustrated in 

PIG 2 a control 202 in the server ,02 preferably includes a centra, 

processing un* 204 electrically coup,ed by an address/data bus 206 to a 

be any type of we,, Known CPU, such as an Intel Pentium™ processor. The 
memory device 208 preferably includes volatile memory, such as a random- 
access memory (RAM), and non-vo,a,i,e memory, such as a read on,y 
memory (ROM) and/or a magnetic disK. The memory device 208 stores a 
software program that may implement all or par, of the method described 
b e,ow This program is executed by the CPU 204, as is we,, Known. 
However, some of the steps described in the method be,ow may be 

208 a,so stores data, files, praams, web pages, etc. for retrieva, and update 
by the PCs 104 and/or scanning devices 106. 

The server 102 may exchange data with other computing 
d evices via a connection to the network 108. The network interface circuit 
210 may be implemented using any data transceiver, such as an Ethernet 

^ MfiR mav be anv type of network, such as a local 
transceiver. The network 108 may be any iyw 

area network (LAN) and/or the Internet. 
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A more detailed block diagram of a PC 104 is illustrated in FIG. 
3 Like the server 102. .he PC 104 includes a controller 302 which preferably 
includes a centra, processing unit 304 Metrically coupled by an address/data 
bus 306 to a memory device 308 and an interface circuit 310. Again, the CPU 

processor, and me memory device 308 preferably includes volatile memory 
and non-vo,a,ile memory. However, as discussed above, the CPU 304 and/or 
memory device 308 associated with a typical PC 104 may not be as powerful 
as the CPU 204 and/or memory 208 associated with a typical server 102. 
Like the server 102, the memory device 308 associated with the PC 104 
stores a software program that may implement all or part of the method 
described below. This program is executed by the CPU 304. as is well 
known. However, some of the steps described in the method below may be 
performed manually or wrthou, the use of the PC 104. The memon, dev,ce 
308 also stores data. files, programs, web pages, etc. retrieved from a server 
1 02 and/or transmitted by a scanning device 1 06. 

The interface circuit 310 may be implemented using any type of 
we,, known interface standard, such as an Ethernet interface and/or a 
Universal Serial Bus (USB) interface. One or more input devices 312 may be 
connected to the interface circuit 310 for entering data and commands into the 
control 302. For example, the input device 312 may be a keyboard, mouse. 

system One or more output devices 314 may also be connected to the 
controller 302 via the interface circuit 310. Examples of output devices 314 



include cathode ray tubes (CRTs), liquid orysta, displays (LCDs), speakers, 
and/or printers. The output device 314 generates visual displays of data 
generated during operation of the PC 104. The visual displays may include 
prompts for human operator input, run time statistics, calculated values, 

detected data, etc. 

The PC 104 may also exchange data with other computing 

devices via a connection 316 to the network 108 and/or a direct connection 
data transceiver 318. The network connection 316 may be any type of 
network connection, such as an Ethernet connection, digital subscriber line 
(DSL), telephone line, coaxial cable, etc. The data transceiver 318 may be 
any type of data transceiver, such as an infrared transceiver, a radio 
transceiver, a Universal Serial Bus transceiver (USB), etc. 

A more detailed block diagram of a scanning device 106 is 
crated in FIG. 4. The scanning device 106 also Includes a controller 402 
which preferably includes a centra, processing unit 404 electrically coupled by 
an address/data bus 406 to a memory device 408 and an interface circuit 410. 
Although, the scanning device CPU 404 may be any type of well known CPU, 
typically the scanning device CPU 404 is less powerful than the PC CPU 304 
and the server CPU 204. Similarly, the scanning device memory 408, which 
preferably indudes volatile and non-volatile memory, is not as large as the PC 
memory device 308 and the server device 208. Like the server 102 and PC 
104 the scanning device memory 408 stores a software program that may 
implement all or part of the method described below. This program is 
executed by the CPU 404, as is well known. However, some of the steps 



described in .he method below may be performed manually or without the use 
of the scannihg device 106. The memory device 408 may also store an 
identification code, authorization codes, pass codes, Input data, audio data, 
and/or visual data. Data stored In memory 408 may be retrieved from a 
machine readable symbol, retrieved from a server 102. retrieved from a PC 
104 and/or stored during the manufacture or setup of the scanning device 

106. 

The interface circuit 410 may be implemented using any data 
transceiver, such as an Infrared transceiver, a radio transceiver, an Ethernet 
transceiver, and/or a Universal Serial Bus (USB) transceiver. One or more 
input devices 412 are connected to the interface circuit 410 for entering data 
and commands into the controller 402. In the preferred embodiment, the input 
device 412 Includes a small number of keys and a bar code reader. 

One or more output devices 414 are connected to the scanning 
device controller 402 via the interface circuK 410. Preferably the scanning 
device 106 includes a liquid crystal display and/or a speaker. The output 
device 414 generates visua, displays and/or audio of data retrieved and/or 
generated during operation of the scanning device 106. The visua, displays 
and audio generated may include prompts for human operator input, run time 

statistics, calculated values, detected data, etc. 

A data transceiver 416 allows the scanning device 106 to 
exchange data with a PC 104. For example, after receiving purchase data by 
scanning one or more bar codes, the scanning device 106 may upload the 
purchase data to a PC 104 for subsequent transfer to a server 102 which 



tuifills the order. The data transceiver 4! 6 may be any input/output device 
such as an infrared transceiver, radio transceiver, serial connection, paralle, 
connection, etc. In addition, the scanning device 106 may also exchange 
data with other computing devices via a connection to the networK 108. The 
connection may be any type of network connection, such as an Ethernet 
connection, digital subscriber line (DSL), telephone line, coaxial cable, etc. 

An exemplary printed page, which may be used for ordering a 
product via a scanning device 106, is illustrated in FIG. 6. In this example, a 
firs, bar code 502 begins the ordering process. The data encoded in this first 
bar code preferably includes a firs, portion which identifies the product as 
shown in an optional product photo 504 and a second portion which defines 
audio and/or visual information which prompts the user for one or more 
subsequent inputs. For example, the first portion may be "SKU=1234ABCD" 
to identify a particular brand and style of T-shirt. The second portion may be 
digitized audio and/or text for "select a color" and/or "select a size." 

in addition, the first bar code may include a third portion which 
enumerates the type and/or amount of data that is required to complete the 
data acquisition process for this product Alternatively, a single bar code may 
be used to specify a complete order. For example, .he pho.o 504 and 
descripfive text accompanying the photo 504 may specify a brand, styie, size, 
color, quantity, etc. In such an instance, an associated bar code may 
represent everything that is needed to order the product. 

Alternatively, a bar code may be indicative of a "style sheet." 
The style sheet defines a predetermined sequence of data to be scanned. 



For example, ,< every product ordering sequence in a particuiar cataiog 
consists o. scanning a product type, followed by a product size, foiiowed by a 

indicates the -product-size-colo,' s,y,e sheet is to be used. Tex, and,or audK, 
prompts for style sheet entry may be preprogrammed into the scanning dev,ce 
,06 in this manner, the data for the prompts need not be stored in the 
ma chine readable symbols. In addition, certain default values may be 
included. For example, If the scanning device detects a new product scan 
without receiving a color scan, a default color and/or an error message may 
be used. 

Other bar codes 506, 508 may be used to enter the additional 
data (e.g., color, size, etc.). Each of these bar codes 506, 508 may a,so 
include portions which define audio and/or visual information prompfng the 
user for addKiona, inputs. In this manner, the user may be led through the 

appreciate that processes other than ordering products may be employed. 
For example, data entry of a predefined form may be performed (e.g., a 
survey, a medical form. etc.). In addition, the user may enter certain data in a 
tradttiona, manner. For example, quantities may be entered via a numenc 
keypad, or colors may be indicated by two letter abbreviations. 

A flowchart of a process 600 for providing audio and/or visual 
feedback to a user during a shopping sequence (or other sequence) based on 
audio and/or visual data encoded in a machine readable symbol is illustrated 
in fig 6. Preferably, the process 600 is executed by the scanning dev,ce 



CPU 404 as ,s we,, Known. However, one or more o. the steps described 
b e,ow may be performed ,n function wKh another device, a user. and,or 
without the use of a CPU. GeneraUy. the process 600 receives shopp,ng data 
andto r other information from one or more machine readab,e codes. ,n 
addKion, the process receives prompting data from the machine readab,e 
oodes. The prompt data is used to generate audio and/or visua, prompts 
to aide the user. Subsequently, the shopping data is transmKted to a web s„e 
which fulfills the indicated purchase request. 

The process 600 begins by receiving Internet shoppmg 
formation (or other information, via the scanner 412 from a machine 
re adab,e symbol, such as a bar code symbol (step 602, The Internet 
shopping information is then parsed into input data, promoting data. and,or 
other data (step 604,. Input data includes user selections such as product 
identflers. quantities, etc. Prompting data includes audio and,or visual data 
us ed to prompt and/or aide the use, Other data may include termination data 
such as the number and/or type o, input data entries required. Although ai. of 
this data is preferably stored in memory 408 a. least temporary the input 
data in particular is accumulated for subsequent transmission (step 606). 

„ more input data is needed (step 608). the process uses the 

dlsplay 414 of the scanning device 106 (step 610). Preferably, the prompt 
requests the user to scan another symbol to enter additional Internet shopping 
.formation. If a compiete set o, input data is acquired (step 608). the process 
600 transmKs the stored input data to a web site (step 612). The transmission 



may be performed directly by the scanning device 106 or indirect via a PC 
10 4 .„ a preferred embodiment, .he scanning device 106 transmits the 
stored input data to a server 102 via a PC 104 when the scanning device 106 
is cradled in a device connected to the PC 104 or when the scanning dev,ce 

106 is brought within transmitting range of the PC 104 (e.g., using infrared or 

radio signals). 

Preferably, the Internet address of the web site server 102 ,s 
included in a scanned symbol. However, in an alternate embodiment, the 
scanning device 106 and/or the PC 104 is preprogrammed wHh a centralized 
web site address. The se„er 102 located at the centralized address and/or 
». PC 104 then determines the ultimate web sKe address. In this manner, 

in the machine readable symbols. 

■„ summary, persons of ordinary skill in the art wiil readily 
appreciate that a method and apparatus for providing audio/visual feedback to 
scanning pen users has been provided. Systems implementing the teachings 
described herein can utilize audio and/or visual feedback provided to a user 
during a shopping sequence (or o*er sequence, based on audio and/or 
visual data encoded in a machine readable symbol. 

The foregoing description has been presented for the purposes 
of i„ustra.,on and description. I. is no, intended to be exhaustive or to limit the 
invention to the exemplary embodiments disclosed. Many modHications and 
variations are possible in light o, the above teachings. I. is intended that the 



scope of the invention be limited not by this detailed description of exemplary 
embodiments, but rather by the claims appended hereto. 
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